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THE GANDY-HYLAND FUNCTIONAL AND A HITHERTO 
UNKNOWN COMPUTATIONAL ASPECT OF NONSTANDARD 

ANALYSIS 

SAM SANDERS 


Abstract. In this paper, we highlight a new computational aspect of Non¬ 
standard Analysis relating to higher-order recursion theory. In particular, we 
prove that the Gandy-Hyland functional equals a primitive recursive functional 
involving nonstandard numbers inside Nelson’s internal set theory. From this 
classical and ineffective proof in Nonstandard Analysis, a term from Godel’s 
system T is extracted which computes the Gandy-Hyland functional in terms 
of a modulus-of-continuity functional and a special case of the fan functional. 
We obtain several similar relative computability results not involving Non¬ 
standard Analysis from their associated nonstandard theorems, in particular 
involving the weak continuity functional. By way of reversal, we show that 
certain relative computability results, called Herbrandisations, also imply the 
nonstandard theorem from whence they were obtained. Thus, we establish 
a direct two-way connection between the field Computability (in particular 
theoretical computer science) and the field Nonstandard Analysis. 


1. Introduction 

The aim of this paper is to highlight a new computational aspect of Nonstandard 
Analysis relating to higher-order computability theory. Our object of study is 
the Gandy-Hyland functional , which was introduced in m as an example of a 
higher-type functional not computable (in the sense of Kleene’s S1-S9 from m 
Def. 1.10]) in the fan functional over the total continuous functionals (See [17] 4.61] 
and Section Hi. 1.1 11 . The Gandy-Hyland functional T is defined as follows: 

(3r 3 )(VY 2 e C, 8°) [r(Y 2 , s°) = Y(s * 0 * (An°)r(Y, s * (n + 1)))], (GH) 

where ‘Y 2 £ C’ is the usual definition of (pointwise) continuity on Baire space as 
in m- Additional notations are introduced in Section 12.31 

The definition m apparently exhibits non-wcll-founded self-reference: Indeed, 
in order to compute T at s°, one needs the values of T at all child nodes of s°, as is 
clear from the right-hand side of (EED). In turn, to compute the value of T at the 
child nodes of s, one needs the value of T at all grand-child nodes of s, and so on. 
Hence, repeatedly applying the definition of T seems to result in a non-terminating 
recursion. By contrast, primitive recursion is well-founded as it reduces the case 
for n + 1 to the case for n, and the case for n = 0 is given. 
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In Section 14.11 we show that inside Nelson’s internal set theory (See [16] and 
Section [2]), the following primitive recursive (by [9] Theorem 18]) functional 


H(Y 2 ,s°,M) 


Y(sM * 00 ...) \s\>M 

Y(s * 0 * H(Y, s * 1, M) * ■ ■ ■ * H(Y,s * M, M) * 00 ...) otherwise 


equals the T-functional from fGE0) for standard input and any nonstandard num¬ 
ber M°. Note that one need only apply the definition of H at most M times to 
terminate in its first case. In other words, the extra case ‘|s| > M ’ provides a 
nonstandard stopping condition which ‘unwinds’ the non-terminating recursion in 
T to the terminating one in H. Or: one can trade in self-reference for nonstandard 
numbers. Thus, we shall refer to H as the canonical approximation of T. 


We work in P, a fragment of Nelson’s internal set theory based on Godel’s T, 
both introduced in Section [2] The proof in Section [4] that and T(-) are 

equal for standard inputs and nonstandard M°, takes place in P augmented with a 
nonstandard continuity axiom IN PCI and a nonstandard bar induction axiom IsTPl 
This is a natural setting for T, as it is modified bar recursion in disguise ([HI §4]). 

From the aforementioned proof in P regarding T and H, we shall extract a term 
t from Godel’s T and a proof in higher-order Peano arithmetic that t computes the 
Gandy-Hyland functional in terms of a special case of the fan functional (originating 
from the bar induction axiom) and a modulus-of-continuity functional (originating 
from the nonstandard continuity axiom). Conceptually, it is important to note that 
this final proof, as well as the term t, does not involve Nonstandard Analysis , and 
that the extraction of the term t from the proof proceeds via an algorithm. In 
Sections 14.31 to 14.61 we obtain further nonstandard results from which we extract 
related relative computability results. 

Furthermore, it is a natural ‘Reverse Mathematic^ style’ question if from a 
relative computability result (obtained from Nonstandard Analysis), the ‘original’ 
nonstandard theorem can be re-obtained. In answer to this question, we show in 
Section 14.21 that (a proof of) the original nonstandard theorem (that the Gandy- 
Hyland functional T(-) equals for all standard inputs and nonstandard M) 

follows from (a proof of) a certain natural relative computability result, called the 
Herbrandisation of the original nonstandard theorem. 


In conclusion, while these relative computability results are not necessarily deep 
or surprising in and off themselves, the methodology by which we arrive at them 
constitutes the real surprise of this paper, namely a new computational aspect of 
Nonstandard Analysis: From a classical-logic proof in which no attention to com¬ 
putability is given at all, and in which Nonstandard Analysis is freely used, we 
obtain a relative computability result in a straightforward way. With some atten¬ 
tion to detail, a natural relative computability result, called the Herbrandisation, 
allows us to re-obtain the original nonstandard theorem. In this way, we estab¬ 
lish a direct two-way connection between the field Computability (in particular 
theoretical computer science) and the field Nonstandard Analysis. 


1 As it turns out, the Gandy-Hyland functional may also be viewed as the limit for n -> oo of 
a certain operator Ap ( |l5l 8.3.10]). While the nonstandard approach from this paper certainly 
applies to this limit result, it is our opinion that the canonical approximation via H is simpler. 

2 For an introduction to the foundational program Reverse Mathematics, we refer the reader 
to Simpson’s monograph ED- 
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2. About and around internal set theory 

In this section, we introduce the base theory P in which we will work. In two 
words, P is a conservative extension of Godel’s system T with certain axioms from 
Nelson’s Internal Set Theory (na) based on the approach from m- 

2.1. Internal set theory and its fragments. In this section, we discuss Nelson’s 
internal set theory , first introduced in [16| , and its fragments from [4]. 

In Nelson’s syntactic approach to Nonstandard Analysis am as opposed to 
Robinson’s semantic one ([18]), a new predicate ‘st(*)’, read as ‘x is standard’ is 
added to the language of ZFC, the usual foundation of mathematics. The notations 
(V st a;) and (3 st y) are short for (V.r)(st(ai) —»•...) and (3y)(st(y) A...). A formula is 
called internal if it does not involve ‘st’, and external otherwise. The three external 
axioms Idealisation , Standard Part , and Transfer govern the new predicate ‘st’; 
They are respectively definecjfl as: 

(I) (V st fin x)(3y)(Vz G x)ip(z,y) (3 y)(y st x)<p(x,y), for internal ip with any 

(possibly nonstandard) parameters. 

(S) (Va: st )(3 st ?/)(V st 2:)((2 6iA <p(z)) z € y) , for any formula ip. 

(T) (\/ st x)(p(x,t) —> (yx)ip(x,t), where ip is internal, t captures all parameters 
of (p, and t is standard. 

The system 1ST is (the internal system) ZFC extended with the aforementioned 
external axioms; The former is a conservative extension of ZFC for the internal 
language, as proved in [16: . 

In [4], the authors study Godel’s system T extended with special cases of the 
external axioms of 1ST. In particular, they consider nonstandard extensions of the 
(internal) systems E-HA^ and E-PA W , respectively Heyting and Peano arithmetic 
in all finite types and the axiom of extensionality. We refer to J3J §2.1] for the 
exact details of these (mainstream in mathematical logic) systems. We do mention 
that in these systems of higher-order arithmetic, each variable x p comes equipped 
with a superscript denoting its type, which is however often implicit. As to the 
coding of multiple variables, the type p* is the type of finite sequences of type p, 
a notational device used in [4] and this paper; Underlined variables x consist of 
multiple variables of (possibly) different type. 

In the next section, we introduce the system P assuming familiarity with the 
higher-type framework of Godel’s T (See e.g. [4j §2.1], [2] , [H], or [24]). 

2.2. The system P. In this section, we introduce the system P. We first discuss 
some of the external axioms studied in [3], First of all, Nelson’s axiom Standard 
part is weakened to HACj nt as follows: 

(V st x p )(3 st y T )p(x, y) (3 st F p ^ )(V st x p )(3y T G F(x))tp(x,y), (HAC int ) 

where ip is any internal formula. Note that F only provides a finite sequence of 
witnesses to (3 st y), explaining its name Herbrandized Axiom of Choice. Secondly, 
Nelson’s axiom idealisation I appears in [4] as follows: 

(y st x a * ) (3y T )(\/z a G x)<p(z,y) -t (3y T )(\/ st x a )<p{x, y), (I) 


^The superscript ‘fin’ in (I) means that x is finite, i.e. its number of elements are bounded by 
a natural number. 
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where <p is again an internal formula. Finally, as in {4j Def. 6.1], we have the 
following definition, where E-PA“ is just Peano arithmetic in al finite types with 
the axiom of extensionality, and E-PA W * is a definitional extension of the latter with 
extra types for finite sequences of objects (See [4] §2.1] and Section [Oil . 

Definition 2.1. The set T* is defined as the collection of all the constants in the 
language of E-PA W *. The system E-PA“ t * is defined as E-PA“* + Tff + IA bt , where 
T s l consists of the following axiom schemas. 

(1) The schemrd st(ar) A x = y —>- st (y), 

(2) The schema providing for each closed term f g T* the axiom st(f). 

(3) The schema st(/) A st(rc) —> st(f(x)). 

The external induction axiom IA st is as follows. 

(<f>(0) A (V st n°)(<I>(n) —>• 4>(n + 1))) —> (V st m°) < l>(m). (IA st ) 

The nonstandard system P = E-PA“ t * + HAC; nt + I + IA bt is connected to E-PA“* 
by Theorem 12.31 The superscript ‘S a t in the latter is the syntactic translation 
defined as follows in [4] Def. 7.1]. 

Definition 2.2. If <h(a) and \I/(fo) in the language of P have interpretations 

$(a)' Sst = (V st x)(3 st y)(^(x, y,a) and ^(b) Sst = {V st u)(3 st v)ip(u,v, b), (2.1) 

then they interact as follows with the logical connectives by [4] Def. 7.1]: 

(i) ip Sst := ip for atomic internal ip. 

(ii) (st(^)) Sat := (3 st x)( 2 = a;). 

(iii) (-i$) Sst := (V st T)(3 st :r)(Vt/ £ ¥]x\)~“P{-!Li Vi &)■ 

(iv) ($ V 'F) Sst := (V st x,u)(3 st y,v)[ip(x, y,a) V ip(u,v,b)]. 

(v) ((V^)$) SBt := ( V st x){3 st y)(\/z)(3y' £ y)ip(x,y^, z). 

Theorem 2.3. Let $(a) be a formula in the language of E-PA“ t * and suppose 
$(a) Sst = V st x3 st y tp(x, y,a). If A- mt is a collection of internal formulas and 

P + A int h $(a), (2.2) 

then one can extract from the proof a sequence of closed terms t in T* such that 
E-PA W * + Aj nt F Vx3 y £ t(x) ip(x,y,a). (2-3) 

Proof. Immediate by [4] Theorem 7.7]. □ 

The proofs of the soundness theorems in 4] §5-7] provide an algorithm to obtain 
the term t from the theorem. The following corollary is only mentioned in [4] for 
Hey ting arithmetic, but is also valid for Peano arithmetic. 

Corollary 2.4. If for internal ip the formula (a) = (V st x)(3 st y)ip(x, y, a) satisfies 
(12.21) . then (\/x)(3y £ t(x))ip(x,y, a) is proved in the corresponding formula (12.31) . 

Proof. Clearly, if for ip and 4> as given we have 4>(a) Sst = ^(a), then the corollary 
follows immediately from the theorem. A tedious but straightforward verification 
using the clauses (i)-(v) from Definition 12.21 establishes that indeed < I>(a) ,S3t = (a). 

This verification may also be found in p~9l §2] or [20] §2.1]. □ 

4 The language of E-PA^* contains a symbol st CT for each finite type a. but the subscript is 
always omitted. Hence is an axiom schema and not an axiom. 
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With regard to notation, for the rest of this paper, a normal form refers to a 
formula of the form (y st x)(3 st y)tp(x, y) for ip internal. 

The previous theorems do not really depend on the presence of full Peano arith¬ 
metic; It is an easy verification that the proof of [4j Theorem 7.7] goes through for 
any fragment of E-PA 1 "’* which includes EFA, sometimes also called IAo + EXP. In 
particular, the exponential function is (all what is) required to ‘easily’ manipulate 
finite sequences. It should be a straightforward verification to show that the below 
proofs also go through for E-PA W replaced by E-PRA W from |I3j §2], 

Finally, we point out an an interesting property of the previous theorem. 
Remark 2.5. Consider Theorem 12.31 with Aj nt = (3 2 ) defined as follows: 

(d^XV/ 1 ) [(3n°)(/(n) = 0) o tp(f) = 0]. (3 2 ) 

Note that the resulting term t in (12.31) is still a term from Godel's T, i.e. does not 
involve the Turing jump functional tp from (3 2 ), as the latter principle is internal. 
Hence, even though P+(3 2 ) involves the Turing jump functional, the terms resulting 
from term extraction as in Theorem 12.31 are computable (in the sense of Godel’s T). 

On the other hand, consider P + STJ, where the latter is the external principle: 

(3 s V 2 )[(V/ 1 )((3n°)(/(n) = 0) o p{f) = 0)], (STJ) 

i.e. the claim that the Turing jump functional is standard. If P H- STJ proves 
(W st x)(3 st y)'iff(x, y) for internal then P proves the normal form 

(V st x,p 2 )(3 st y)[TJ(v) (2.4) 

where TJ(y>) is the internal formula in square brackets in STJ. Applying Corol¬ 
lary [231 to (12.41) . we obtain a term t such that E-PA W * proves 

(Vx,ip 2 ){3y G t(a:,^))[TJ(<p) 

i.e. the term resulting from term extraction does involve the Turing jump func¬ 
tional now. In conclusion, the internal principles A; nt in Theorem 12 . 31 may state the 
existence of non-computable objects without affecting the term t in m - However, 
external principles like TSJ do affect the term extraction process. Or: Only stan¬ 
dard objects are relevant to the term extraction process (as also explicitly noted in 
the proof of [4j Theorem 7.7]). 

2.3. Notations. We finish this section with some remarks on notation. First of 
all, we mostly follow Nelson’s notations, as sketched now. 

Remark 2.6 (Nonstandard Analysis). We write (V st x T )<f , (x r ) and (3 st x°’)’I / (x' T ) 
as short for (Vx T ) [st(x T ) —> <f>(x T )] and (3x CT ) [sXx' 7 ) A ^(x 17 )]. We also write 
(Vx° G f2)$(x°) and (3x° G fl)4'(x°) as short for (Vx°) [-ist(x°) —¥ 4>(x 0 )] and 
(3x°) [-ist(x°) A ^(x 0 )]. Furthermore, if -ist(x°) (resp. st(x 0 )), we also say that x° 
is ‘infinite’ (resp. finite) and write ‘x° G f V. A formula A is ‘internal’ if it does not 
involve st, and A st is defined from A by appending ‘st’ to all quantifiers (except 
bounded number quantifiers). 

Secondly, the usual extensional notion of equality is used in P. 

Remark 2.7 (Equality). The system P includes equality between natural numbers 
‘=o’ as a primitive. Equality ‘= T ’ for type r-objects x, y is then defined as: 

[x = T y] = (Wp ... zff)[xzi ... Zk =o yzi. ■. Zk\ 


(2.5) 
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if the type r is composed as r = (n r k —> 0). In the spirit of Nonstandard 

Analysis, we define ‘approximate equality ~ T ’ as follows: 

[x » T y] = (y^zl 1 ... zl k )[xz! ...z k = o yz± ...z k \ (2.6) 

with the type r as above. The system P includes the axiom of extensionality for 
all <p p ^ rT as follows: 

(Vx p ,y p )[x = p y -A <p(x) = T <p(y)\. (E) 

However, as noted in j4] p. 1973], the so-called axiom of standard extensionality 
(0 st is problematic and cannot be included in P. Finally, we need the following 
explicit version of the axiom of extensionality ©■ 

(V/V)(/-(/,«?) = 0 gZ(f,g)^Y(f) = 0 Y(g)). (EXT(2, Y)) 

We say that S 2 is an extensionality functional of the functional Y 2 . 

Thirdly, we use the usual notations related to sequences from [3J §2.1]. 

Remark 2.8 (Finite sequences). The system E-PA“* has a dedicated type for 
‘finite sequences of objects of type p\ namely p*. Since the usual coding of pairs 
of numbers goes through in E-PA 1 ^*, we shall not always distinguish between 0 and 
0*; See e.g. the definition of the Gandy-Hyland functional in Section [1] 

For sequences s p ,t p , we denote by ‘s * t' the concatenation of s and t. For a 
sequence s p , we denote by |s| its length, and by sN = (s(0)... s(N)) for N° < |s|. 
For a sequence a 0_>,p , we also write aN = (a(0)... a(N)) for any N°. By way of 
shorthand, r p G R p * abbreviates (3i < |i?|)(i?(z) = p r). 

Finally, we introduce some (strictly speaking) abuse of notation. 

Remark 2.9 (Set-theoretic notation). As is clear from the previous remark, we 
sometimes use intuitive set-theoretic notation in this paper, although P only in¬ 
volves functionals. First of all, we assume that sets X 1 are given by their char¬ 
acteristic functions fx, i.e. (Va; 0 )[a; G X -fA fx{x) = 1]. Secondly, the notation 
l Y 2 £ C’ means that Y is continuous on Baire space ‘as usual’ given by (HU). A 
formula (V st F 2 € C)(...) is thus shorthand for (VH 2 )([st(F) A Y G C] —> ...); 
Note in particular that no mention whatsoever of lTU st is made, or will be made 
below. Thirdly, we sometimes block quantifiers together to save space; In this way, 
the formula (V(F 2 G C, Z 2 ) G T)(...) for some ip 2 , is shorthand for 

(vz 2 )(vr 2 )([Y gca (3 j < |)(*tf) = 2 r) a (3* < |$|)($(») = 2 z)\^...), 

which arguably saves space. 


3. Preliminaries 

In this section, we prove some preliminary results needed below. In particular, 
we study two weak fragments of the Standard Part principle of 1ST in Section 13. II 
Furthermore, in Section 13.21 we derive a version of bar induction for external for¬ 
mulas from a weak fragment of the Standard Part principle of 1ST. 

3.1. Fragments of the Standard Part principle. In this section, we discuss 
two fragments of the Standard Part principle of 1ST essential to our results. Recall 
that weak Konig’s lemma , denoted WKL, is the statement that every infinite binary 
tree has a path (See e.g. |2U IV]). 
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3.1.1. Nonstandard weak Konig’s lemma. In this section, we establish that the fol¬ 
lowing fragment of the Standard part principle is a nonstandard version of WKL. 

(V/ 1 <! 1)(3 S V <1 1)(/ ~i g)- (STP) 

The function g l from ISTPl is called the standard part of f 1 . 

Theorem 3.1. The system P proves that 1ST Pi is equivalent to 

(VT 1 <! 1) [(V st n)(3/?°)(|/3| = n A /3 £ T) (3.1) 

(3 S V <i 1 )(VV)(crneT)]. 

where ‘ T <i 1 ’ denotes that T is a binary tree. Over P. ISTPI is also equivalent to 

(V/ 1 )(3 st 5 1 )((V st n°)(3 st TO°)(/(n) = m) -A / g). (3.2) 

Proof. Assume ISTPI and apply overflow to (V st n)(3/3°)(|/3| = n A /3 £ T) (See 
Prop. 3.3]) to obtain /? 0 £ T with nonstandard length |/? 0 |. Now apply ISTPl to 
/3q * 00... to obtain a standard path through T. For the reverse direction, let / 1 
be a binary sequence, and define a tree Tf which contains all initial segments of /. 
Now apply (13.11) to obtain I5TP1 

For the remaining equivalence, the implication (13.21) - { STPI is trivial, and for 
the reverse implication, fix / 1 such that (V st n)(3 st m)/(n) = m and let h 1 be 
such that (Vn,m)(/(n) = m ■ O- h(n,m) = 1). Applying HAQ nt to the former 
formula, there is standard $ 0 ^ 0 such that (V st n)(3m £ $>(n))f(n) = m, and dehne 
'F(n) := maxj < |$( n )i 4>(n)(i). Now dehne the sequence ao as follows: ao(0) : = 
h( 0,0), a 0 (l) := h( 0,1), ..., a 0 (*(0)) := h( 0,T(0)), ao($(0) + 1) := ^(1,0), 
ao( v h(0) + 2) := h(l,l), ..., ao(H/(0) + 'P(l)) := A(l, 4/(1)), et cetera. Now let 
/3 q <i 1 be the standard part of ao provided by ISTPI and dehne g[n) := (p,m < 
*(«))[# 0 (Er=o 1 'i / ( i ) + m) = l]. By dehnition, g 1 is standard and / g. □ 

The function g 1 from (13.21) is also called the standard part of f 1 . We now show 
that ECS follows from the nonstandard uniform continuity of all type two func¬ 
tionals on Cantor space. Note that the principle INUCI in the theorem contradicts 
classical mathematics, as the latter involves discontinuous functionals. 

Theorem 3.2. The axiom ECE1 can be proved in P plus the axiom 

(V^^V/'.S 1 <1 1)(/ »1 g -► Y(f) =0 Y{g)). (NUC) 

Proof. First of all, note that INUCI implies by dehnition (and classical logic) that 

(y st Y 2 )(y f 1 , g 1 <! 1)(3 st N°)(gN = 0 JN -A Y(f) = 0 Y{g)). (3.3) 

Applying idealisation I to (13.31) . we obtain that 

(V Bt y 2 )(3 rt O(V/ 1 , 5 1 <i l)(gNo = 0 JN 0 -A F(/) = 0 F(<?)). (3.4) 

Thus, every standard Y 2 is bounded on Cantor space; In particular, for Y and 
No as in (f5~H) we have (V/ 1 <i l)(Y(f) < max ff < 0 , ik\<t\=n 0 )Y (cr * 00 ...), which 
yields a standard bound. Now consider the contraposition of m for some hxed 
T <i 1, and assume (V^a 1 <i l)(3 st n°)(cm ^ T). Similar to the second part 
of the previous proof, applying HACj nt yields a standard functional Yff such that 
(V^a 1 <i 1)(3* < Y 0 (a))(ai ^ T). By the previous, Y 0 is bounded on Cantor space, 
yielding (3 st /c°)(V/? 1 <i l)(3i < k)(/3i £ T ), and lSTPI follows from Theorem l3.ll □ 
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As explained in the introduction, the theme of this paper is the extraction of 
relative computability results from theorems of Nonstandard Analysis. We now 
provide the first example of this theme in Corollary 13.31 based on the proof of 
NUC —> STP in the previous theorem. The following definitions are relevant. 

(vy 2 )(v/V <! 1 )(fn(Y)=gSl(Y)^Y(f) = Y(g)). (MUC(fi)) 

(Vg 2 , T 1 <1 1) [(Vo 1 € Q(g)(2))(a <i 1 -A ag(a ) £ T) -A (SCF(0)) 

(V/3<r 1)(3* < 0 G(g)(l))(pi?T)]. 

The functional H 3 as in MUC(fl) is called the fan functional and is essentially a 
conservative extension of WKL for the second-order language (See [121 Prop. 3.15]). 

We now show that 0 as in SCF(@) is a ‘special case’ of the fan functional; Thus, 
we sometimes refer to the functional 0 as the special fan functional. 

Corollary 3.3. From the proof in P that NUC —> STP, a term t can be extracted 
such that E-PA“* proves (Vfi 3 )[MUC(fi) -A- SCF(£(fi))]. 

Proof. By the proof of the theorem, NUC is equivalent to the normal form (13.41) . 
which we abbreviate as (V st F 2 )(3 st W°)A(Y, N). Now note that (13.11) implies 

(VT 1 <! 1)(VV) [(V st a <! 1 )(ag(a) ? T) -A (3.5) 

(3 st fc°)(V/3 <! 1 )(3i<k)(pi#T)\. 

Bringing standard quantifiers outside, we obtain that 

(V st 3 2 )(VT 1 <! l^k^a 1 <! 1 )[(ag(a) # T) -a (V/3 <i l)(3i < k)(0i T)\. 

Applying idealisation I, we pull the standard quantifiers to the front as follows: 

(VVH^V'XVT 1 <! l^Ba 1 <! 1 ,fc° G w)[(ag(a)#T) -A (V/3 <i l)(3t < k)(0i&T)], 

which we abbreviate as (V st g 2 )(3 st r(; 1 )B(g,w). Hence, the proof of INUCI — > STP 
yields a proof of (V st F 2 )(3 st N°)A(Y, N) —>• ('d st g 2 )(3 st w 1 *)B(g,w), which yields 

(V st H 3 )[(VF 2 )A(F,H(F)) -a (y*g 2 )(3*w im )B(g,wj \, 

by strengthening the antecedent. Bringing all standard quantifiers up front: 

(V st H 3 , 5 2 )(3 st u; 1 *)[(VF 2 )A(F,H(r)) B(g,w)]; (3-6) 

Applying Corollary 12.41 to P P (13.61) . we obtain a term t such that E-PA M * proves 

(VH 3 ,g 2 )(3u; g t(H, ff ))[(VF 2 )A(F,H(T)) -a B(g,w)], (3.7) 

Clearly, the antecedent of expresses that H 3 is the fan functional, while f (f2, g) 
is essentially the functional 0 from SCF(0), and we are done. □ 

For comparison, we provide a ‘direct’ proof of the previous corollary. 

Corollary 3.4. There is a termt such that P proves (VH 3 )[MUC(H) —»• SCF(£(f2))]. 

Proof. Note that 0(g) as in SCF(0) has to provide a natural number and a finite 
sequence of binary sequences. The natural number, say 0(g)(1), is defined as 
max| CT i=o(g)Acr< 0 » i g( cr *00...) and the finite sequence of binary sequences, say 
0(g)(2), consists of all r * 00 ... where |r| = 0(g)(1) A r < 0 * 1. We now have 

(V/3 <r l)(/3 G 0(g)(2) -a Xg(/3) t T) -a (V 7 <i l)(3i < 0(g)(l))( 7 * £ T). (3.8) 
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Indeed, suppose the antecendent of (13.811 holds. Now take 70 <1 1, and note that 
A) = 700(g)(1) * 00 • ■• G 9(g)(2), implying AMA)) £ T. But_g(a) < 0(g)(1) for 
all a <1 1 , by the definition of 12 , implying that 7 og(/?o) = A>g(A>) ^ T by the 
definition of An and the consequent of (13.81) follows. □ 

3.1.2. A ‘computable’ fragment of the Standard Part principle. In this section, we 
discuss the Standard Part principle 12-CA, a very practical consequence of HACj nt . 
Intuitively speaking, 12-CA expresses that we can obtain the standard part (in casu 
G) of Q.-invariant nonstandard objects (in casu F(-,M)). 

Definition 3.5. [12-invariance] Let iA^xcO-tO be standard and fix M° G 12. Then 
F(-,M) is 12-invariant if 

(V st x <T )(VN° G 12) [F(x, M ) = 0 F(x, AT)]. (3.9) 

Principle 3.6 (12-CA). Let F^ ax0 ^° be standard and fix M G 12. For 12-invariant 
F(-, M), there is standard G <T_> ' 0 such that 

(V st x CT )(VAf° G 12) [G(a:) = 0 F(x, AT)]. (3.10) 

The axiom 12-CA provides the standard part of a nonstandard object, if the latter 
is independent of the choice of infinite number used in its definition. 

Theorem 3.7. The system P proves 12-CA. 

Proof. Assuming F(-,M°) is 12-invariant, i.e. we have 

(V st x a )(VN°, M° G 12) [F(x, M) = 0 F(x, AT)], (3.11) 

it is easy to obtain (e.g. via minimisation present in P) that 

(\/ st x a ) (3 st k° ) (\/N° , M° > k) [F(x, M ) = 0 F{x, AT)]. (3.12) 

Indeed, note that (13.111) trivially implies (take any m G 12) that 

(V st x a )(3m)(VN°, M° > m ) [F(x, M) = 0 F(x, A/)], 

and obtain the least such m using the (internal) minimisation axioms present in 
P. By (13.111) . this least number must be standard, and we obtain (13.121) . If one 
wishes to avoid induction, one can apply the so-called underspil principle (See 
Prop. 5.11]) to (13.111) to obtain (13.121) directly. 

Now apply HACi nt to (13.121) to obtain standard such that 

(W st x a )(3k° G $(x))(VN°,M° > k)[F(x,M) = 0 FfoAl)]. 

Define U/(a;) := maxj < i$( a ,)| $(*)(*) and note that 

(\/ st x a )(\/N°,M° > $(: x))[F{x,M) = 0 F(x,N)]. 

Finally, define G{x) := F(x , ^(a;)) and note that the latter is as in 12-CA. □ 

Remark 3.8. It is straightforward to verify that Theorem 13.71 also holds if the 
quantifier ‘(V st ir' T )’ in (13.91) and (13.101) is restricted to l (V st x' T )(C(x) —»•...)’, where 
C is any internal formula. We shall also refer to this slight extension as 12-CA. The 
axiom 12-CA can also be generalised to _F’( crx0 ) _! ' T using the approximate equality 
! w t ’ defined in Remark 12.71 However, the above version suffices for our purposes. 


5 We shall henceforth freely invoke the aforementioned underspill principle when working in P. 
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3.2. External bar induction. In this section, we derive a version of bar induction 
from ISTPl The former is a generalisation of the well-known principle of (mathe¬ 
matical) induction of arithmetic. While induction takes place ‘along the natural 
numbers’ (or any well-order), bar induction takes place ‘down a tree’. As an exam¬ 
ple, we consider the following principle. 

Principle 3.9 (Bio). For internal quantifier-free Q(x°), if 

(Va 1 )(3n)Q(an) A (Vf°) [( Vx°)Q(t * (x)) —> Q(t)] (3.13) 

then we have Q(Q). 

Intuitively speaking, bar induction Bio expresses that we may conclude Q{x) for 
x = {) from the fact that Q is implied ‘downwards’ from child nodes to parent 
nodes (second conjunct of (13.131) ') and that Q holds eventually along any path (first 
conjunct of (13. 131) 1. On a technical note, Bl 0 is essentially Bl q f from [23j p. 78] for 
P(n) = Q(n) quantifier-free. We now prove BIq* form ISTPl 

Theorem 3.10. In P -+ [ STP1 we have Bl]) 4 . 

Proof. Assume (I3.13l) st and suppose we have Now define F(x,M) := 

(/am < M)->Q(x * (m)) and put G(0) := F((), M) and G(n + 1) := F{G( 0) * ■ ■ ■ * 
G(n),M). By (I3.13l) st and the assumption -iQ(()), G(0) is standard. Furthermore, 
we also have that G(n+1) is standard if G(k) is standard, for standard n and k < n, 
by (13. 1311 st . implying that G(n) is standard for all standard n by external induction 
IA st . This in turn implies that -iQ(G(0) * ■ ■ • * G(k)) for standard k , by quantifier- 
free induction and (I3.13l) st . Now consider the sequence /3 1 = G(0) * G(l) *G(2) *... 
and take its standard part a 1 . Finally, apply the first conjunct of (13.1311 st and 
obtain a contradiction. □ 

The previous theorem is not that surprising: ISTPl is the nonstandard version of 
weak Konig’s lemma by Theorem 13. II the latter lemma is equivalent to a version of 
dependent choice (See (2TJ VIII.2.5]), and bar induction is a version of the latter. 

Nonstandard Analysis also has a distinct kind of induction, called external in¬ 
duction. We consider the following example. 

Principle 3.11 (Exlnd). For standard F ^ x0 ) _>0 and M £ Cl, if 

st(F(0, M)) A (V st n)[st(F(n, M)) st(F(n + 1, M))], (3.14) 

then (V st n)(st(F(n, M)). 

Intuitively speaking, (Exlnd) tells us that we may use induction on the new 
standardness predicate along the standard numbers (and obviously not along the 
numbers). Although seemingly more general than normal induction, we now derive 
Exlnd from the standardness of the recursor constants in P. 

Theorem 3.12. The system P \ {IA st } proves (Exlnd). 

Proof. Assume (13.141) and replace ‘st’ as follows: 

(V st n)[(3 st fc°)(P(n,M) < k) -»• (3 st l°)(F(n + 1, M) < l ), 

yielding 

(V st n, k)(3 st l)[F{ ni M)<k^F(n+ 1, M) < l\, 
and HACj n t yields standard g such that l = g{n , k) in the previous formula. Use 
primitive recursion to define the standard function h 1 such that h( 0) := F( 0, M) 
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and h(k + 1) := g(k,h(k)). By the definition of h , we have F(n,M) < h(n) for 
standard n, proved by quantifier-free induction (of the non-external variety). As 
h(n) is standard for standard n, (13.141) implies the consequent of (Exlnd). □ 

Note that the same proof goes through for variations of (Exlnd), e.g. if the 
induction hypothesis involves (Vfc < n)(st(F(k, M))) instead of st(F(n, M)). Note 
that (Exlnd) also follows directly from IA st , but the latter cannot be included in 
fragments of P based on E-PRA 1 ^ (See [13l §2]). 

Corollary 3.13. The system P \ {IA st } + STP proves Big 4 . 

We now formulate external bar induction , which is nothing more than bar induc¬ 
tion on the external standardness predicate. 

Principle 3.14 (EBI). For standard a nd M G Cl, if 

(V s V)(3 st n°) [st(F (cm, M))\ (3.15) 

A(V st t°) [(y st x°){st(F{t * (x),M))) -A st {F(t, M))\ (3.16) 

then st (F((),M)). 

As it happens, external bar induction EBI is not much stronger than normal bar 
induction, as we now prove EBI from ISTPl 

Theorem 3.15. The system P 1 1 STPI proves EBI. 

Proof. In Theorem 13.11 we proved that ISTPI is equivalent to (13.11) , which is a non¬ 
standard version of WKL. In particular, (13.11) is just the generalisation of WKL ” 4 to 
all (possibly nonstandard) binary trees. By [22 Note 1, p. 54, and VIII.2.5], WKL 
is equivalent to IljhDCo, the axiom of dependent choice restricted to IIj-formulas; 
The same holds for the ‘usual’ axiom of choice n^-ACo. From this equivalence, 
we immediately obtain that WKL st -o- (II°-DCo) st -O- (IIj’-ACo) 8 * in P. Similar to 
Theorem l3.ll it is now a straightforward but tediomQ verification that ISTPl implies 
(and is equivalent to) the schema expressing that 

(V Bt n°,A- 1 )(3 rt y 1 )j7 Bt (A-,y ) n) -»■ {3 st Z 1 )(y st n°)r 1 s \{Z) n , (Z) n , n), (3.17) 

for any Il^-formula 77 in the language of P. To obtain EBI from (13.171) . assume 
(13.151) and (13.1611 . and suppose F({),M) is nonstandard. Now bring (13.161) in the 
following form 

(V st i°)(3 st a: 0 , m°)(V st Z°) [F{t *(x),M)<l-> F(t, M) < m] , (3.18) 

and apply (13.171) to obtain standard g 1 such that 

(V st t°)(V st /°) [F(t * (g(t)( 1)), M) < l -A- F(t, M) < g(t)( 2)]. (3.19) 

Now consider the standard sequence a 1 defined by a(0) := g(()) (1) and a(n + 
1) := g(an)( 1). By (13.151) . there is standard n such that F(an,M) is standard. 
However, then there is standard l such that F(an, M) = F(a(n — 1) * {g(a(n — 
1))(1)),M) by definition satisfies the antecedent of (13.191) . Hence, F(a(n — 1 ),M) 
is also standard by (13.191) . and external induction (Exlnd) implies that F((),M) is 
standard, a contradiction, and EBI follows. □ 

‘direct’ proof is as follows: Let A(t, x, m, n, l) be the formula in square brackets in (13.1811 
and let / 1 be the characteristic function of A. Now let g be the standard part of / and consider 
the version of (13.1811 — » 113.191 with / replaced by g. This modification follows from (IlC-DCo) 8 * 
(as everything is standard), and hence <3.181 — > (13.1911 follows from STP and Theorem 13.II 
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4. The Gandy-Hyland functional in Nonstandard Analysis 

In this section, we list our main results concerning the Gandy-Hyland functional 
and its so-called canonical approximation H , both introduced in the first section. 
As to its provenance, we recall that the F-functional was introduced in jT2] as 
an example of a functional not Kleene-Sl-S9-computable over the total continuous 
functionals, even with the fan functional as an oracle (See (17, §4] or 15. §8]). 

Using the results from the previous section, we prove in Section 14.11 that the 
Gandy-Hyland functional T(-) equals from Section [T] for all standard in¬ 

puts and nonstandard M; This proof takes place in an extension of the system P 
from Section 12.21 From this nonstandard proof, we extract a term from Godel’s 
T expressing T in terms of the special fan functional (See Corollary 13.3D and a 
modulus-of-continuity functional. Note that this relative computability result does 
not involve Nonstandard Analysis. In Section 14.31 to lT6l we obtain similar nonstan¬ 
dard and relative computability results. In particular, we study the weak continuity 
functional , which was first introduced in J\. 

Finally, we show in Section 14.21 that, one can re-obtain the original nonstandard 
theorem (that the Gandy-Hyland functional T(-) equals iJ(-, M) for all standard in¬ 
puts and nonstandard M ) from the proof of a certain natural relative computability 
result, called the Herbrandisation of the original nonstandard theorem. In this way, 
the latter is seen to have the same computational content as its Herbrandisation. 
The latter can be easily obtained for any nonstandard theorem in this paper. 


4.1. From Nonstandard Analysis to relative computability. In this section, 
we prove that the functional and T(-) are equal for standard inputs and 

nonstandard M° in an extension of P. From this proof, we extract a term from 
Godel’s system T which computes the T-functional as a function of the special fan 
functional (See Corollary 13.31) and a modulus-of-continuity functional. 


To this end, we consider the following functional G , a ‘less Unitary’ version of 
H , but which is still primitive recursive by [5} Theorem 18]. We also refer to G as 
a canonical approximation of F. 


G(Y,s,N ) 


T(s * 00 ...) |s| > N 

Y(s * 0 * (A n)G{Y, s * (n + 1), N)) otherwise 


Now, as noted in the first section, the F-functional corresponds to modified bar 
recursion of type 0 (See [6] §4]). Since bar recursion holds in the model of all total 
continuous functionals (See [7llTT]l. the easiest way of obtaining F from H or G 
seems to be adding the following continuity axiom to P (Recall Remark 12.71) : 

(ysty2 e C) f i )(V 5 1 )(/ g -a Y(f) = 0 Y(g)), (NPC) 


where l Y 2 £ C is the (internal) definition of continuity on Baire space as follows: 

(V/ 1 )^ 0 )^ 1 )^ = 0 JN -a Y(f) = 0 Y(g)). (4.1) 

As discussed in Remark |4. 41 1 N P Cl without the restriction ‘T 2 £ C’ is inconsistent, 
while IN PCI easi 130 follows from the 1ST axiom Transfer. 


'Fix a standard Y 2 G C and standard / 1 as in J4.lt . and apply (the contraposition of) Transfer. 
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Furthermore, according to [BJ p. 167], the role of the continuity principle and bar 
induction in [ 6 ] Theorem 2.5] is to verify the correctness of the [bar recursive] wit¬ 
nessing functional. As was proved in Section l5~21 the principle [STP] from Section l5TTl 
implies a version of bar induction. Hence, we arrive at the following theorem. 

Theorem 4.1. In P + INPCI + ISTPI we have 

(V st Y 2 G C, s°)(VM, N G Cl)(H(Y, s, N) = 0 H(Y, s, M)), (4.2) 

(V st Y 2 G C,s°)(\/M,N G fl)(G(Y,s,N) = 0 G(Y,s,M)), (4.3) 

i.e. the canonical approximations o/F are fl-invariant. 


Proof. We sketch the proof of the theorem and then provide a detailed version. 

First of all, one obtains external bar induction from ISTPI as in Theorem 13.101 
Secondly, one uses this bar induction to prove that G(Y,s,M) is standard for 
standard Y 2 G C,s° and infinite M°. Thirdly, one applies bar induction again 
to prove that (14.211 holds for fixed inputs. Fourth, the result for H(-,M) is now 
straightforward. Intuitively speaking, H and G only really differ in the second case 
of their definition for elements in the sequence with infinite index , which does not 
matter due to nonstandard continuity. We now provide a detailed proof. 

By Theorem 13.101 we may freely use external bar induction EBI. We first prove 
that G(-, M) is standard for standard input and infinite M. To this end, fix standard 
Y 2 G C, s° and M G fl, and define F(x°, M ) := G(Y 1 s * x, M). 

To prove (13.15p . fix standard 7 1 and N G fi. We have 
F(^N, M) = G(Y, s * 7 IV, M) 

= Y(s * 7 N * 0 * (A n)G(Y, s * 7 N * (n + 1), M )) (4-4) 

= Y(s* 7 ), (4.5) 

where the final step follows by nonstandard continuity IN PCI as s *7 £, where the 

latter is the sequence in (14.41) . We have proved that (WK G tl)F(fyK) = Y(s * 7 ) 
and underspill yields (V st 7 1 )( 3 st m)(Vn > m)(st(F(fyn, M))) and hence (13.151) . 

To prove (13.161) , assume the antecedent of the latter for standard t, and consider 
F(t, M) = G(Y, s*t, M) 

= Y(s *t* 0 * (A n)G(Y, s *t* (n + 1), M)) 

= Y(s*t* 0* (A n)F(t * (n+ 1), M)) (4.6) 

which follows by the definitions of F and G. However, the antecedent of (13.161) tells 
us that F(t * (m),M) are standard for any standard m. Hence, the sequence 


s *t *0 * F(t * 1, M) * F(t * 2, M) * F(t * 3, M) * ... (4.7) 

has a standard part by MB say 7 1 , and INPCl yields F(t,M) = Y(q), which is 
standard. Hence, we obtain (13.161) . and F((),M) = G(Y,s,M) is standard by EBI. 

Now define the function F(x, M) as follows: 


F(x, M) 


0 G(Y, s * x, M) = G(Y, s * x, M + 1) 
M otherwise 


(4.8) 


where Y 2 G C and s° are standard again. Repeating the steps from the previous 
paragraph of the proof, we note that F(-,M) satisfies (13.151) and (13.161) for any 
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M G Q. Hence, EBI yields that F((),M) is standard for any infinite M; As a 
consequence, we have G(Y, s, M ) = G(Y, s, M + 1) by definition, for any infinite M. 
Hence, fOll . the second half of Theorem 14.11 is proved. The proof of the first part 
is completely analogous. □ 


The Gandy-Hyland is unique as noted in [121 §6] and [T5J §8.3.3]. We now prove 
a similar result, for which we require the following formula: 

(V st Y 2 G C, s°) [T(Y 2 , s°) = Y(s * 0 * (An°)T(Y, s * („ + 1)))]. (GH st (T)) 

The following corollary expresses that the standard and unique Gandy-Hyland func¬ 
tional equals its canonical approximations. 


Corollary 4.2. In P 4 fNPCl 4 fSTPl the Gandy-Hyland functional exists and equals 
its canonical approximations, i.e. there is standard T 3 such that GH st (T) and 

(V st Y 2 G C, s°)(V7V G f2)(G(Y, s, N) = H(Y , s, N) = T(Y, s)). (CA(T)) 


Furthermore, the Gandy-Hyland functional is unique in that every functional T such 


that GH st (T) satisfies CA(T) 


Proof. By (14.31) . G(Y,s,M ) is Q-invariant and fl-CA and Remark 13.81 yield the 
standard part of G(Y, s, M), say Fo(Y, s). For standard Y 2 G C, s° and M G O, 


T 0 (Y, s) = G(Y, s, M) = Y(s * 0 * G(Y, s*l,M)* G(Y, s * 2, M) * ...) (4.9) 

= Y(s * 0 * T 0 (Y, s * 1) * T 0 (Y, s * 2) * ...), 


where we used fNPCl in the final step. Hence, the standard part T 0 (-) of G(-,M) 
as provided by Sl-CA is indeed the Gandy-Hyland functional as GH st (To) follows 
from CA(T) To prove the uniqueness as in the corollary, suppose there is another 
Ti such that GH st (Ti) and define F(x, M) as in (14.81) . but with G(Y, s * x, M + 1) 
replaced by Ti(Y, s * x). Now proceed as in the proof of the theorem to establish 
that To(Y, s) = G(Y, s, M) = Ti(Y, s) for standard Y 2 G C, s° and MgSI. □ 


As noted above, the Gandy-Hyland functional is not computable (in the sense of 
Kleene’s S1-S9) in terms of the fan functional over the total continuous functionals. 
The following corollary expresses that the Gandy-Hyland functional as in GH(T) 
may be computed (via a term in Godel’s T) from the special fan functional (See 
Corollary 13. 3D and a moclulus-of-continuity functional. 

(VY 2 G C, a 0 ) [T(Y 2 , s °) = Y(s * 0 * (An°)T(Y, s*(n + 1)))]. (GH(T)) 

(VY 2 G C,/ 1 ,3 1 )(74 , (Y,/) = g*{Y,f) Y(f) = Y(g)). (MPC(T)) 

Variations of the following relative computability result are discussed below. 

Corollary 4.3 (Term extraction I). From the proof in P of 

[NPCl+ rsTPU (VT 3 ) [GH st (T) -a CA(T)] , (4.10) 

a term t 4 can he extracted such that E-PA“* proves for all ©,\I/,r that 

[GH(T) ASCF(0) A MPC(4-)] -4- (VY G C, s)(G(Y, s, t(Y, s, 0, 4-) = T(Y, s)) (4.11) 

i.e. G(Y, s,t(Y, is the Gandy-Hyland functional expressed in terms of a 

modulus-of-continuity functional, and the special fan functional. 
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Proof. The following formula is provable in P by Corollary 14. 2 1 

(VT 3 ) [[GH st (T) A STP / {N PC] -> CA(T)]. (4.12) 

We shall bring all the components in normal form and apply Corollarv l2.4l to obtain 
the term t from the theorem. First of all, resolving £ «i’ in IN PCI implies 

(V st F 2 G C, f 1 )(Vg 1 )(3 st N)(JN =„ gN -a F(/) = 0 Y(g)), 

and applying idealisation I, we obtain 

(V st F 2 G C, f 1 )(3 st N) [(y g 1 )(fN = 0 gN -a Y(f) = 0 F( fl ))], (4.13) 

and let A(Y ., /, N) be the formula in square brackets. Secondly, let (\/ st g 2 )(3 st w 1 )B{g, w) 
be the normal form of STP formulated in the proof of Corollarv l3.3l Thirdly, Corol¬ 
lary H21 combined with underspill implies that for all T such that GH s t(T) we have 

(V st F 2 G C, s°)(3 st I<) [(VJV > K)(G(Y, s, N) = 0 T(F, s ))], 

and let C(Y, s, K, T) be the formula in square brackets. Thus, the proof of (14.121) 
gives rise to a proof of the statement that for all T and all standard 0, ik, we have 

[(V st F 2 G C, f 1 )A(Y, /, T(F, /) A (V st W 2 )B(W, ©(W)) A GH st (T)] (4.14) 

->■ (V st Z 2 G C',s)(3 st A^)C'(Z,s,^,r), 

and strengthening the antecedent of (14.141) to internal formulas: 

(V st e,f,2GG,s)(VT)(3 st lV 0 ) (4.15) 

[[(VF G C, f)A(Y ., /, (F, /) A (VW 2 )B(W, 0(W)) A GH(T)] -a C(Z, s, N, T)]. 

Apply idealisation I to pull the existential quantifier through ‘(VT)’ as follows: 

(V st 0,T,Ze C, s)(3 st N°) 

(VT) [[(VT G C, f)A(Y , /, $(Y, /) A ( VW 2 )B(W, 0(W)) A GH(T)] —> C(Z, s, N, T)]. 

Apply Corollarv l2.4l to obtaii^l a term t such that E-PA“* proves for 0, ik, Z £ C, s, T 

((VF G C, f)A(Y, /, $(F, f))MyW 2 )B(W,, 0(W))AGH(T)) -a C(Z, s, t(0, 4/, Z, s),T). 

Clearly, (VF G C,/)A(F,/, 4'(F,/)) expresses that tk is a modulus-of-continuity 
functional, and ( VW 2 )B(W ,, 0(W)) expresses that 0 is the special fan functional as 
in SCF(0). Bringing the Z and s quantifiers into the consequent, we get (14.111) . □ 


We now discuss possible strengthenings of the above results. 

Remark 4.4 (Similar results). It is an interesting question if the condition ‘F 2 G C’ 
in the previous results can be weakened. First of all, we cannot drop this condition: 
As shown in the proof of Corollary 14.31 IN PCI gives rise to a modulus-of-continuity 
functional 4' as in MPC(’F) Intuitively speaking, tk is rather discontinuous and from 


the existence of the latter for all type two functionals (i.e. without the restriction 
‘F 2 G C’ in |MPC(4>)[ ), one constructs a discontinuous type two functional, yielding 
a contradiction (See [TU] and [3] Theorem 19.1]). Secondly, going through the proofs 
in this section, it is becomes clear that ‘F 2 G C' can be replaced everywhere by any 
internal formula D(Y 2 ), as long as the latter formula blocks the aforementioned 
contradiction in the same way as ‘F 2 G C does. 


^Corollary 12.-II provides a finite sequence of possible witnesses, of which t is the maximum. 
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In light of the previous remark and Em Prop. 3.7], the existence of a modulus- 
of-continuity functional implies the Halting problem. In Sections 14.31 and 14.41 we 
obtain relative computability results similar to (14.111) with weaker antecedents. We 
now discuss how the consequent of the above results can be strengthened. 

Remark 4.5 (Similar results II). It is a natural question if the consequent of 
(14.111) is the best possible result. A careful study of the proofs of Theorem |4J] and 
Corollary 14.21 reveals the existence of standard T 3 such that GH st (r) and 

(V st F 2 G C, a 1 )(VAC 0 , M° G fi) (4.16) 

(Vs°)(aM = 0 s * 00 .. .M -> T(Y, s) = 0 G(Y, s, N)). 

Indeed, if s° is standard, then the associated instance of (14.161) follows from the 
above results. If s° is nonstandard, it has a as a standard part and (14.161) follows by 
nonstandard continuity as in NPC. Applying term extraction to a variation of (14.101) 
involving (|4.16[) , one obtains a term u which computes the Gandy-Hyland functional 
‘more uniformly’ than the term t in (14.111) . in that u provides one stopping condition 
for every initial segment s° of the sequence a 1 . We shall obtain an equivalence 
between (14.161) and NPC in Section [4751 

In conclusion, we have proved in Theorem 14.11 that the functional H(-,M) and 
T(-) are equal for standard inputs and nonstandard M°. From this proof, we have 
extracted a term from Godel’s T which computes the T-functional as a function of 
the special fan functional and a modulus-of-continuity functional. While these rel¬ 
ative computability results are not necessarily deep or surprising, our methodology 
constitutes the true surprise: That from the rather ineffective proof of Theorem 14.II 
involving Nonstandard Analysis, the term t as in Corollary 14.31 may be extracted. 

4.2. From relative computability to Nonstandard Analysis. In the previous 
section, we showed how to extract relative computability results like (14.111) from 
corresponding nonstandard statements like (14.101) . Now, it is a natural ‘Reverse 
Mathematics style’ question whether it is possible to re-obtain the nonstandard 
implication from (a variation of) the associated relative computability result. 

Another natural question is whether we can obtain a version of (14.111) with 
weaker assumptions; Indeed, to compute T(Y, s ) it should -intuitively speaking- 
sufhce to have a functional which (only) behaves like the special fan and modulus- 
of-continuity functional for Y (and functionals explicitly defined from the latter). 

To answer these two questions, we define the Hebrandisation of (14.111) as follows. 

Let SCF(0,g) be SCF(0) with the leading quantifier involving g dropped. Let 
MPC(\I/, Y, /) be MPC(’I') with the leading quantifier involving Y and / dropped. 

Let GH(T,Y s) be GH(4/) with the leading quantifier involving Y and s dropped. 

Definition 4.6 (Herbandisation). The Herbrandisation HER(*,o) of (14.121) is the 
statement that for all H = (0, 4/) and all T 3 , Y 2 G C, s° 

[(V(Z 2 G C, t°) G i(Y, s, S)(1)))GH(T, Z, t) A (V1T 2 G i(Y, s, 3)(2))SCF(0, W) 

A (V(Y 2 G CJ 1 ) ei(Y,s, 3)(3)) MPC(*,V,/)] -> (VM > o(Y,s,Z))(G(Y,s,M) =T(Y,s)). 

Intuitively speaking, the Herbrandisation HER(i,o) expresses that to compute 
r(F, s) via its canonical approximation involving the term o, it suffices that the 
special fan and modulus-of-continuity functionals satisfy their usual definition on 
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the restriction of their domains provided by i. By the following corollary, the non¬ 
standard version (14.121) has the same computational content as its Herbrandisation. 

Theorem 4.7. From the proof of (14.121) in P, terms i 4 , o 4 can be extracted such 
that E-PA W * proves HER(z,o). Furthermore, if there are terms i,o such that the 
system E-PA“* proves HER(z,o), then P proves (|4.12jl . 

Proof. For the first part of the corollary, consider the proof of Corollary 14.31 and 
obtain the following non-weakened form of (14.151) : 

(V st Q, , Z G C, s)(Vr 3 )(3 st N°, Y G C, /, g, V, t) [[A(Y, /, *(Y, /)) A SCF(0, g) 

A GH(r, V, t)] —)• C(Z, s, N, r)]. (4.17) 

Now apply idealisation I to obtain 

C,s)(3 st W){VT 3 )(3{N°,Y G C,f,g,V,t) G W) (4.18) 

[[A(Y, /, $(y, /)) A SCF(0, g ) A GH(r, V, t)] —> C(Z, s, N, r)], 
and apply Corollary 12.41 to obtain a term w such that E-PA“* proves 

(V0, f.ZGC, s)(3IT G «7(0, 4/, Z, s))(VT 3 )(3(N 0 , Y G C, /, g, V ., t) G W) 

[[A(Y, /, vh(Y, /)) A SCF(0, g) A GH(F, V, t)] —> C{Z , a, IV, r)]. 

Define the term o as follows: o(0, \F, if, s,) is the maximum of the components of 
u>(0, ’F, Z , s) pertaining to TV; Similarly, define the term *(0, \F, Z, s)(j) for j = 1 
(resp. j = 2 and j = 3) to be the finite sequence of all components of w pertaining 
to the variables Y, f (resp. g and V, t). Thus, we obtain HER(i, o) as defined above. 

For the second part, if there are terms i,o such that E-PA W * h HER(z,o), then 
P l~ [HER(z, o) Ast(z) Ast(o)] by the second standardness axiom from Definition ^. II 
Thus, for standard 5 = (0,41) and standard Y 2 G C,s°, the terms i(Y, s, S) and 
o(y,a,H) are standard (by the third standardness axiom from Definition l2.il) . and 
HER(z, o) implies the following weakening (for any T 3 ): 

[(V st Z 2 G C, t°)GH(r, Z, t) A (V st W' 2 )SCF(0, W) (4.19) 

A (V st C 2 G C, / 1 )MPC(4', V, /)] -)• (VM G D) (G(Y, a, M) = F(Y, a)), 

Applying HAC int to ([443]) . [NPCl implies (d 8 *^)^ 8 *^ G C, /)MPC(4', Y, /). Simi¬ 
larly, STP implies (3 st D 3 )(V st y 2 )SCF(0, Y) by the proof of Corollary 13.31 Hence, 
INPCI +STP implies the second and third conjunct of the antecedent of (14.191) . which 
yields (14.121) . and we are done. □ 

In this section, we have proved that from a proof of (14.121) . terms i,o from 
Godel’s T can be extracted which satisfy the so-called Herbrandisation of (14.121) . 
i.e. o computes r(Y, s) as a function of approximations enforced by i of the special fan 
functional and a modulus-of-continuity functional. Furthermore, the nonstandard 
version (14.121) implies its Herbrandisation, i.e. they have the same computational 
content in the sense of Theorem 14.71 

In conclusion, the correspondence exhibited in Theorem 14.71 establishes a di¬ 
rect two-way connection between the field Computability (in particular theoretical 
computer science) and the field Nonstandard Analysis. Indeed, while the relative 
computability result HER(z,o) could arguably still be passed off as (theoretical) 
computer science, experience bears out that the nonstandard version (14.101) does 
not count as such among computer scientists. 
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4.3. From Nonstandard Analysis to relative computability II. In this sec¬ 
tion, we obtain a relative computability result involving the Gandy-Hyland func¬ 
tional, but not mentioning the modulus-of-continuity functional. To this end, we 
shall establish that the proofs of Theorem 14.II and Corollarv l4.2l also go through for 
other principles appearing in the context of bar recursion. 

First of all, consider the ‘full’ fan functional as follows: 

(VY 2 G C^XV/V <! h)(?Sl(Y,h) =0 gSl(Y,h)^Y(f) =„ Y(g)), (FFF(fi)) 
and the related nonstandard continuity principle: 

(V st Y 2 G CrfWf 1 ^ 1 <! h){f «! g -4 Y(f) = 0 Y(g)). (FFF ns ) 

Secondly, the weak continuity functional is defined as follows: 

Principle 4.8 (PWC). There is a functional Y 3 such that 

(VF 2 eC,f 1 ,g 1 )\jT(YJ)=gr(YJ)^Y(g)<T(Y,f)], (PWC(T)) 
and T (Y, /) is the least number with this property. 

The nonstandard principle associated to PWC is the following (See also (14.201) '): 

(V st F 2 G G, /'XV) [/ «r g -4 st (Y(g))}. (PWC ns ) 

We refer to [6} §2.5 and Lemma 5.4] for more details on these functionals and their 
relation to bar recursion. 


Theorem 4.9. The proofs from Theorem \j.l\ and Corollary \f.2\ in P ■ [ NPClASTPI 
go through for lNPCl replaced fejy |FFF ns l and PWC ns [ 


Proof. It is straightforward to prove that PWC ns has the following normal form: 

(V^Y 2 G c> \Jn = gn -a Y(g) < n] , (4.20) 

In the proof of Theorem 14.11 in Section 14.11 every instance of nonstandard (point- 
wise) continuity fNPCl can be replaced by combining nonstandard continuity via 
EEE3 and nonstandard weak continuity via fPWC^J 

For instance, to obtain that (14.41) is standard, apply the weak continuity principle 
|PWC ns | to Y G G and s * y. Similarly, the sequence in (14.71) has a standard part 
bv ISTPI Applying the weak continuity principle |PWC ns | to this standard part, (14.61) 
turns out to be a standard number. 


The second part of the proof involving m is similar: One uses the weak conti¬ 
nuity principle | PWCnsI and lSTPl to obtain a standard upper bound for all sequences 
involved, and FFF n5 provides the required continuity (using the aforementioned 
upper bound as h 1 in FFF ns ). 

For instance, for standard y 1 ,^ 2 G C',s° and N G fl, the sequences 
/3o := s * yiV * 0 * (A n)G(Y, s * yA * (n + 1), M) 

(3i := s * y N * 0 * (An)G(Y, s * y N * (n + 1), M + 1) 
satisfy /3q /3i and (3q, f3\ <i h, where h(i) := max{Y(F, s * y),y(z), s * 00 .. .(I)} 

and where Y results from applying HACj nt to (14.201) and defining Y(Y, /) as the 
maximum of the output sequence. Note that h 1 is standard and apply FFF n5 for 
Y 2 G C and /?i, (do <i h to obtain: 

G(Y, s * y N, M) = Y(/3 0 ) = Y{fi i) = G(Y, s*x,M + 1), 
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implying that F("/N,M) = 0 and (V st 7 )(ViV G fl)st(F("fN, M)). Underspill now 
yields (13.1511 . The remaining part of the proof, namely (13.161) . is now analogous. □ 

Corollary 4.10 (Term extraction II). From the modified proofs of Theorem E3 
and Corollary \4.2\ inside P + STP + FFF ns + PWC ns , a term t 4 can be extracted such 
that E-PA“* proves for all fl 3 , Y 3 ,r 3 ,@ that 

GH(T) A SCF(0)AFFF(U) A PWC(T) 

(VT 2 G C t s°) ( G(Y ., s, t(Y, s, Q, T, ©)) = T(Y, s )), 

i.e. G(Y,s,t(Y,s,£l, T, 0)) is the Gandy-Hyland functional expressed in terms of the 
‘full’ fan functional, the special fan functional, and a weak continuity functional. 

Proof. Analogous to Corollary 14.31 A normal form of PWC ns is (|4.20j) . □ 

Following Definition 14.61 it is easy to define the Herbrandisation of (14.121) for 
IN PCI replaced by FFF ns and PWC ns , and obtain a result similar to Theorem 14.71 


4.4. From Nonstandard Analysis to relative computability III. In this sec¬ 
tion, we obtain a ‘pointwise’ relative computability result involving the Gandy- 
Hyland functional, which additionally only mentions the special fan functional. 

To this end, we shall establish that the proofs of Theorem 14.II and Corollary 14.21 
also go through ‘in a pointwise fashion’, to be understood in the sense of Theo¬ 
rem [TTT] Recall from Section FT21 the formula GH(r, Y,s) and define NPC(F) as 
IN PCI with the leading universal quantifier involving Y dropped. 


Theorem 4.11. The system P + STP proves that 


(v st y,s)(vr 3 ) [NPC(F)AGH(r,y, s )] (yN gQ)(t(y, s ) = g(y,s,n)) . ( 4 . 21 ) 


Proof. Fix r 3 and standard F 2 ,s° as in the antecedent of (14.211) . In exactly the 
same was as in the first part of the proof of Theorem l4.ll one proves that G(Y. s, N ) 
is standard for any N G H. Indeed, in the aforementioned proof part. I N PCI is only 
applied to the functional Y 2 , i.e. NPC(F) is sufficient to prove st (G(Y,s,N)). 

Analogous to (14.81) . fix N G D and define F{x, N ) as follows: 


F(x, N) 


0 G{Y,s*x,N)= 0 r{Y,s*x) 

N otherwise 


(4.22) 


We shall use EBI to prove that st (F((),N)), finishing the proof. To prove (13.151) . 
note that for M G !1 and standard a 1 , we have G(Y,aM,N ) = Y{a) = T(Y,aM), 
by the nonstandard continuity of Y 2 and the fact that (aM * 7 ) «i a for any 7 1 . 
As in the proof of Theorem 14.11 one obtains (13.151) using underspill. 


To prove (13.161) . fix standard t° and assume st (F(t * (x))) for all standard x°. 
By H4.22D . we have G(Y, s*t* (x),N) = F(F, s*t*{x)) for any standard x°. By the 
previous part of the proof and STP, the sequence s*t*0* (Xn)G(Y, s*t* (n+ 1)), N) 
has a standard part, say 7 1 . By assumption, we have 


s *t*0* (A n)G{Y, s *t* (n + 1)), N) «i 7 s * t * 0 * (Am)r(Y, s *t* (m + 1)), 


and the nonstandard continuity of Y yields: 


G(Y, s *t,N) = Y(s *t * 0* (A n)G(Y, s * t * (n + 1)), N) (4.23) 

= Y(s *t * 0 * (Am)r(Y, s *t * (m + 1))) = r(Y, s * t), 
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which implies that st {F(s * t,N )), and (13.1611 follows. □ 

Let PCM(F 2 , H 2 ) be the expression that H is a modulus of continuity for Y. i.e. 
we have 63 and N° is additionally given by H(f). 

Corollary 4.12 (Term extraction III). From the proof of (14.2111 in P + STP, a 
term t can be extracted such that E-PA^* proves for all Y, s , g , T, 0 that 

[PCM(Y,c/0 A SCF(0) A GH(T, Y, s)} -A (YN > t(Y , s,g, 0))(T(F, s) = G(Y , s, N)), 

i. e. the value of the Gandy-Hyland functional can be computed from a modulus of 
continuity of the input functional , and the ( special ) fan functional. 

Proof. We sketch how one obtains a normal form for STP —>• (14.211) ; Applying 
Corollary 12.41 then finishes the proof. The normal form of STP has been studied in 
the proof Corollary 14.31 The normal form of NPC(K), obtained in the same way as 
the normal form of INPCI in the proof of Corollary 14.31 is 

(V st / 1 )(3 Bt JV) [(Yg 1 )(fN = 0 gN -> Y(f) = 0 Y(g ))], 
and applying HACj nt , one sees how the modulus of continuity of Y comes about. □ 

Following Definition 14.61 it is easy to define the Herbrandisation of (14.2111 and 
obtain a result similar to Theorem l4~7l In particular, this Hebrandisation tells us 
on which part of Baire space the functional Y should be continuous (with modulus 
H) to guarantee that T and G coincide at Y. 

Thus, we have obtained a ‘pointwise’ relative computability result involving the 
Gandy-Hyland functional which only mentions the special fan functional. In partic¬ 
ular, the term t from Corollary 14.121 allows us to compute the value of the Gandy- 
Hyland functional in terms of the (special) fan functional for any functional Y with 
a modulus of (pointwise) continuity. It should be noted that the statement ev¬ 
ery continuous functional on Baire space has a modulus of pointwise continuity , is 
rather weak by Q31 Prop. 4.4 and 4.8]. 

We finish this section with a remark on how the relative computability results in 
this paper may be used. We thank Dag Normann for his advice in these matters. 

Remark 4.13 (Known associates). As noted above, the fan and Gandy-Hyland 
functionals are not computable over the total continuous functionals in the sense 
of Kleene’s S1-S9 schemas. Nonetheless, these functionals do have a computable 
representation in the form of a type one recursive associate (See jTTl §4]). In the 
case of the fan functional, this associate has even been implemented in Haskell ([5]). 

Furthermore, all terms from Godel’s T have canonical interpretations in the type 
structure of the Kleene-Kreisel countable functionals (See |T7] §2] for the latter) and 
this interpretation provides canonical associates. Thus, in Kleene’s second model 
(See e.g. [3] §7.4, p. 132]), for a term f 4 of Godel’s T and D the fan functional, t(Q) 
can be computed by evaluating the associate for t on the associate for D. Similarly, 
every functional Y 2 with a modulus of (pointwise) continuity H 2 has an associate 
defined explicitly in terms of Y and H (See [14] §4]). 

Thus, the term extraction result in Corollary 14.121 express the associate of the 
objects being approximated in terms of the associates of the input objects. 
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4.5. From Nonstandard Analysis to relative computability IV. In this sec¬ 
tion, we show that the approximation of the Gandy-Hyland functional as in (14.1611 is 
equivalent to NPC, and derive the associated relative computability result in which 
a term from Godel’s T expresses a modulus-of-continuity functional in terms of an 
‘approximation’ functional for the Gandy-Hyland functional. 

Principle 4.14 (GHS). There is standard T 3 such that GH st (T) and 

(V st F 2 G C, a 1 )(W°, M° G fi)(Vs°)(aM = 0 s * 00 .. .M -A r(F,s) = 0 H(Y,s,N)). 

Theorem 4.15. In P, we have GHS - 4 NPC1 

Proof. In two words, to obtain [NPC] from GHS, one computes for Y 2 G C the 
numbers Y(a) and Y((3) using GHS and notes that they are identical if a /? for 
standard a 1 and any /3 1 . In more detail: Applying underspill to GHS, we get 

(V st F 2 G C, o 1 )(3 st A'°)(W°, M° > K)(Ws°)(aM = 0 s * 00 .. .M -A r(F,s) = 0 H(Y,s,N)). 

Applying HACi nt to the previous formula yields a standard functional S 3 such that 

(V st F 2 G C,a l )(yN°,M° > S(y,a)) 

(Vs°)(aM = 0 s * 00 .. .M -A r(Y,s) = 0 H(Y,s,N)). (4.24) 

Now fix standard Y 2 G C and standard a 1 , and any /3 1 such that a ~i /3. Since 
Y 2 G C, there are numbers N$, M$ such that 

(Vy^yMo = 0 pMo ->■ ^( 7 ) =0 Y(J3)). (4.25) 

(Vy 1 )^ = 0 aN 0 —>■ Y( y) = 0 Y(a)). (4.26) 

If Mo or No is standard, we have Y(a) = Y(0), and we are done. Otherwise, we 
have Y(aN 0 * 00...) = Y(a) and Y((3M 0 * 00...) = Y{fS) by (14.251) and (14.26H . 

The following equalities now follow from the above. Note that S(Y, a) is standard. 

Y{a) = Y(aN 0 *00...) = H(Y,aN 0 ,N 0 ) = r(7,aJV 0 ) (4.27) 

= H{Y,aN 0 ,E(Y,a)) (4.28) 

= y(aS(y, a) * 00...) 

= Y(/3E(Y,a)* 00...) 

= H{YjM 0 ,E(y,a)) 

= T(Y,0M o ) 

= H(Y,pMo,M 0 ) 

= Y(pMo * 00...) =y(/ 3 ). 

For instance, to conclude (14.281) from (14.271) . one applies (14.241) for s = aN 0 and 
N = S(y, a) and M = No- The other equalities are proved similarly. □ 

Corollary 4.16. JnP + STP we have GHS -o- NPC. 

Now define GHS(4',r) as the following formula: 

(VF 2 G C,a\N,M> ^(Y,a),s°)(aM = s*00...M -a H(Y,s,N) = 0 r(Y,s))), 

which expresses that 'll witnesses the canonical approximation of T via H in a ‘more 
uniform way’ than is the case of CA(r). 
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Corollary 4.17 (Term extraction). From the proof P + GHS I [ NPCl a term t A can 
be extracted such that E-PA^* proves for all T 3 , iF 3 that 

[gh(t) AGHS($,r)] -ampc( t(r,*)). (4.29) 

Proof. Analogous to the proof of Corollary 14.31 □ 

An analogous result for weak continuity as in PWC is now easily obtained. Fol¬ 
lowing Definition 14.61 it is easy to define the Herbrandisation of GHS - 4 NPCl and 
obtain a result as in Theorem 14.71 

In light of (14.291) and (14. 11 1) . there are terms from Godel’s T expressing the 
Gandy-Hyland functional as a modulus-of-continuity functional and vice versa. As 
it turns out, there is also a rather recent model-theoretic characterisation of the 
Gandy-Hyland functional, namely m Theorem 9.5.4, p. 460], which states that 
the totality of the Gandy-Hyland functional in a (computationally closed) model is 
equivalent to that model satisfying arithmetical comprehension. 

Consequently, it is a natural question (due to Dag Normann) whether our results 
are related to the aforementioned model-theoretic result (involving partial function¬ 
als). We first discuss the connection between arithmetical comprehension and the 
existence of a modulus-of-continuity functional without Nonstandard Analysis. 

Remark 4.18. As it turns out, the existence of a modulus-of-continuity functional 
as in (3'F)MPC(’F) is equivalent to arithmetical comprehension (p 2 ) as follows: 

(V 2 ) [(V/ 1 )) (3 n°)f(n) = 0 f{p{f)) = 0)]. {p 2 ) 

Indeed, for the forward implication, consider [101 p. 156] where a discontinuous 
functional is defined from a modulus-of-continuity functional. The existence of 
the former is proved to yield (p 2 ) in [T3] Prop. 3.7 and 3.9]. On the other hand, 
following the proof of [l4l Prop. 4.7], one can (explicitly) define a modulus-of- 
continuity functional in terms of arithmetical comprehension ( p 2 ). 

In light of the previous remark, the term t in the consequent of (|4.29|) can be 
modified to obtain (p 2 ), modulo the use of the quantifier-free axiom of choice as in 
the proofs of m Prop. 3.7 and 3.9]; Similar modifications for (14.111) are possible. 

While the aforementioned results regarding arithmetical comprehension and the 
T-functional bear some resemblance to m Theorem 9.5.4, p. 460], they are not 
really satisfactory. On the other hand, how would one express totality in a system 
like P where all functionals are total anywayl We discuss these matters in the next 
sections where we also improve upon the results of this section. 

4.6. From Nonstandard Analysis to relative computability V. In this sec¬ 
tion, we study the equivalences between NPC, the T-functional approximation as 
in Gorollarv 14.21 and the following fragment of Nelson’s axiom Transfer: 

(WV 1 ) [(V st n)/(n) = 0 -> (Vm)/(m) = 0 ] (n°-TRANS) 

From these equivalences, we obtain relative computability results for arithmetical 
comprehension, the P-funtional, and a modulus-of-continuity functional. As it turns 
out, n°-TRANS is the ‘precursor’ of (p 2 ) in the same way NPC is for (3T)MPC('I'). 

In this section, we shall work with associates of continuous functionals, rather 
than the functionals themselves. We first consider the definition of associate from 
[T4l Def. 4.3] and then motivate why this choice changes very little. 














THE GANDY-HYLAND FUNCTIONAL AND NONSTANDARD ANALYSIS 


23 


Definition 4.19. [Associate] The function 7 1 is an associate of Y 2 G C if: 

(i) (V/^XBfcObOSfc) > 0 , 

(ii) (V/3 1 ,/c 0 )( 7 (W > 0 -A Ytf) + 1 =0 703*0)- 

We assume an associate 7 1 to be a neighbourhood function (See [HI §4]), i.e. 

(Vct°, r°, n°)((cr WA 7 (an) > 0) —> 7 (a) =0 7 ( 7 -)). (4.30) 

We now argue why working with associates is natural (in our context). First of all, 
consider the following fragment of the axiom of choice. 

Definition 4.20 (QF-AC 1,0 ). For internal and quantifier-free tpo, we have 

(\/x 1 )(3y°)g>o(x, y) -A (3F 2 )(Wx 1 )ip 0 (x, F(x)). (4.31) 

Applying QF-AC 1,0 to item £[]) in Definition 14.191 the latter gives rise to a con¬ 
tinuous functional Y 2 by putting Y(a) := 7 (aF(a)) — 1. As it turns out, QF-AC 1,0 
is a very weak principle, as established in |131 §2]. 

Secondly, as noted above, the proof of [14, Prop. 4.4] contains an explicit def¬ 
inition for obtaining an associate from a functional and its modulus of pointwise 
continuity. Hence, in the presence of a modulus-of-continuity functional, working 
with associates rather than the continuous functionals themselves seems to amount 
to the same thing. Finally, the logical framework for Reverse Mathematics (EH) is 
second-order arithmetic, and one is thence forced to work with associates to study 
e.g. continuous functionals on Baire or Cantor space. 

In light of the previous observations, it seems acceptable to work with associates 
directly, in the context of this paper. Thus, let us denote by ‘ 7 1 € C' the first 
item of Definition 14.191 plus the requirement on neighbourhood functions (14.3011 . 
We shall denote the ‘value of 7 1 G C at a 1 ’ by ‘ 7 (a)’, which is understood to be 
7 (aN) — 1, assuming the latter is at least zero, i.e. for large enough N. An equality 
‘ 7 (a) =0 mj]’ is interpreted as (Vn°)( 7 ( 0 - 71 ) > 0 -A 7 (an) =0 mo + 1)). In the 
presence of QF-AC 1,0 , 7 (a) may be defined as "f(aF(a)) — 1, where F originates 
from the former choice axiom. With these conventions, NPC” (resp. GH” S ) as follows 
make perfect sense in P (resp. P + QF-AC 1,0 ). 

(V S V G C, a 1 )(V/3 1 )(a «r 0 -A 7 («) =0 7(0)), (NPC°) 

(3 st r 3 ) [(V S V G C')(Vs°)GH(r, 7 , s) (GH“ S ) 

A (V S V G <7, s°)(VN G n)(£( 7 , s, N) = F( 7 , a))], 
where H is H but with Y(s * 11...) rather than Y(s * 00 ...) in the first case. 
Theorem 4.21. The system P proves NPC° -fA n^-TRANS. 

Proof. For the implication n°-TRANS —> NPC°, fix standard 7 1 G C, standard 
a 1 , and any /3 1 s=s a 1 . Now consider (3k°)j(ak) > 0, implying ( 3 st fcg) 7 (aA:) > 0 
by n°-TRANS. As 7 is assumed to be a neighbourhood function, we also have 
'y(fiko) > 0 for the same ho- Since a fi, we obtain 7 (a) = 'y(fi), and NPC®. 

Working in P + NPC®, suppose nJ-TRANS is false, i.e. there is standard h 1 such 
that (V st n)/i(n) = 0 and (3mo)/i(mo) 0. Define standard 7 1 as follows: 


7(cr) := 


1 + a((/m < \a\)h(n) 0) (3 n < \a\)h(n) 0 

0 otherwise 


(4.32) 
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Clearly, 7 1 G C and NPC® implies that the latter is nonstandard continuous. How¬ 
ever, for /3m := 00.. .M * MM ..., we note that 0o ~i /3 mo and Tifio) = 0 7 ^ mo = 
7 (/?m 0 ) if h(mo) 7 ^ 0. This contradiction yields NPC® —>• n°-TRANS. □ 

Let MU(p) be the formula in square brackets in (/ 1 2 ) and let MPC®^ 2 ) be 

(V 7 1 G C)(V/V <1 1)(5^(7,/) =0 7^(7,/) —^ l{f) =0 7 (ff))- 
The innermost formula in MPC®(\I/) is not quantifier-free due to =0 7 ( 3 )’- 

Corollary 4.22. From the proof of NPC” aa n°-TRANS in P. terms s,t can be 
extracted such that E-PA 1 ®* proves 

(V/Lt 2 )[MU(/i) -a MPC°(a(/i))] A(V4' 2 )[MPC°(4') -a- MU(«(f))]. (4.33) 

Proof. To obtain a normal form for NPC®, proceed in the same way as for NPC and 
(14.131) . The normal form for n°-TRANS is obvious, namely: 

(V*/ 1 )^) [(3m)/(m) ^ 0 -A (3*° < n)/(i) ^ 0]. 

Now bring NPC® AA n°-TRANS in normal form and apply Corollarv l2.4l □ 


In light of Theorem !!. H and Corollarv l4.21 it is easy to obtain a proof of n°-TRANS 
GH” S in P + QF 1,0 -p STP. One can show that GH® S makes senses in P + n^-TRANS, 
i.e. QF-AC 1,0 is not needed. The more interesting reversal is as follows. 

Theorem 4.23. The system P + QF-AC 1,0 proves GH® S —> n°-TRANS. 


Proof. Working in P + QF-AC 1,0 + GH® s2 , we show that every 7 g G C is non¬ 
standard continuous, implying NPC® and thus n^-TRANS by Theorem 14.211 If 
(V st a 1 )( 3 st iV) 7 (aA r ) > 0 for 70 G C, then the latter is nonstandard continuous. We 
now derive a contradiction from ( 3 st ao)(V st -/V) 7 0 (d 7 V) = 0 for some fixed 70 G C. 
Fix such ao, 7 o and define the standard function 7 1 G C as follows: 


7 (cr) : = 


1 + cr((/Ltn < |cr|)7o(a 0 n) ^ 0 ) (3 n < |cr|)7o(a 0 ) ^ 0 

0 otherwise 


(4.34) 


Note that 7 (a) = a(mo) where mo is the least m such that 70 (am) 7 ^ 0. Now 
compute r( 7 , ()) as follows: T( 7 , ()) = 7(0 * (A?r)T( 7 , n + 1)) = T( 7 , mo) and 

T( 7 , m 0 ) = 7 (m 0 * 0 * (An)T( 7 , m 0 * (n + 1))) = T( 7 , m 0 * (m 0 - 1)) 


Similarly, we have T( 7 , mo*(mo — 1)) = T( 7 , mo*(mo — l)*(mo — 2)), and ultimately 

r( 7 , 0 ) = r( 7 , mo * (mo — 1) * • • • * 1) = y(mo * (mo — 1) * • • ■ * 1 * 0 * (A n )(...)) = 0. 

However, by the definition of H, we also have that 

H( 7 , (),m 0 - 2 ) = 7(0 *H( 7 , l,m 0 - 2 ) * . ..Hfy,m 0 - 1, m 0 - 2 ) * 11 ...) = 1 , 

where mo is again the least m such that h(rn ) 7 ^ 0. This contradiction yields 
n°-TRANS, and we are done. □ 


The associated principles and corollary are now as follows. 

(V 7 1 G C, s°) [r( 7 , s°) = 7 (s * 0 * (An°)T( 7 , s * (n + 1)))]. (GH°(T)) 

(V 7 1 G C, s)(VIV > 4/(7 ,s))(H(7,s,^) =0 r( 7 ,s)) (GHS”(T,T)) 
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Corollary 4.24. From the proof o/GH® s —> II^-TRANS in P + QF-AC 1 ’ 0 , a term t 
can be extracted such that E-PA W * + QF-AC 1 ' 0 proves that 

(V4' 3 ,r 3 ) [[GH°(r) a ghs°( 4/,r)] -»• mu (t($,r))]. ( 4 . 35 ) 

Proof. Similar to the proof of Corollary 14. 221 □ 

Note that the choice principle QF-AC 1,0 is internal, implying that the term in 
(14.3511 is still a term from Godel’s T, i.e. not involving choice functionals from 
QF-AC 1,0 , by [3J Theorem 7.7]. Furthermore, following the proof of Theorem 14.231 
in detail, it becomes clear that the condition T is standard’ is superfluous, implying 
that the term in (14.351) really only depends on 4'. 

Finally, we study the following variation of GH” S : 

(3 st r 3 )[(V s y € c)(Vs°)GH(r, 7l s) (gh” s2 ) 

A (V st 7 \ e 1 G C, s°){ 7 «i e -> r( 7 , s) = 0 F(e, s )], 

which expresses that the Gandy-Hyland functional is standard extensional similar 
to 0 st defined in Remark 12.71 Note that n°-TRANS immediately yields standard 
extensionality © st from ‘usual’ extensionality © for standard functionals p 2 . The 
reverse implication is again more interesting. 

Theorem 4.25. The system P + QF-AC 1,0 proves GH” s2 —> II 0 -TRANS. 

Proof. As in the proof of Theorem l4.23l suppose (3 8 t aJ)(V st Af) 7 o(aA7) = 0 for some 
fixed 7 q G C. Let y 1 G C be as in (14.341) and recall that r( 7 , ()) = 0 by the proof 
of Theorem 14.231 Now define e 1 G C as in (14.341) , but with 2 + ... in the first case, 
and note that y e but T(e, (}) = 1 + ■ ■ • ^ 0. This contradiction yields NPC” 
and hence II 0 -TRANS by Theorem 14.211 □ 

Recall the notion of ‘extensionality functional’ from Section 12.31 Note that an 
extensionality functional for T 3 from GH® s2 makes sense in the presence of QF-AC 1,0 . 

Corollary 4.26. From the proof of GH” s2 —> n°-TRANS in P + QF-AC 1 a term 
t can be extracted such that E-PA W * + QF-AC 1,0 proves that 

(VS 2 ,r 3 )[[GH°(r)AEXT(S,r)] -»■ MU(t(H,r))]. (4.36) 

Proof. Similar to the proof of Corollary 14.221 The normal form of standard exten¬ 
sionality as in GH® s is as follows: 

(V st 7 \ e 1 G C, s°)(3 st N)( 7 yN = 0 eN r( 7 , s) = 0 F( £ ,«)], 

which explains the provenance of the extensionality functional in (14.361) . □ 

Note that the existence of an extensionality functional follows trivially from © 
and QF-AC 1,0 . In other words, (14.361) expresses (p 2 ) in terms of the F-functional 
defined on associates, quite similar to m Theorem 9.5.4, p. 460]. Of course, the 
latter theorem is formulated with partial functionals, while all functionals in P are 
total. We show in the next section that P can ‘simulate’ partiality (relative to the 
standard world); We also argue that this ‘standard partiality’ explains the results 
in this section. 
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4.7. Concluding remarks. We have shown that certain theorems from Nonstan¬ 
dard Analysis give rise to (effective) relative computability results. This resonates 
nicely with the longstanding (but speculative) claim that Nonstandard Analysis is 
somehow ‘constructive’ or ‘effective’, captured well by the quote: 

It has often been held that nonstandard analysis is highly non¬ 
constructive, thus somewhat suspect, depending as it does upon 
the ultrapower construction to produce a model [... ] On the other 
hand, nonstandard praxis is remarkably constructive; having the 
extended number set we can proceed with explicit calculations. 
(Emphasis in original: [lj p. 31]) 

Similar observations regarding the ‘constructive or effective content of Nonstandard 
Analysis’ are made in numerous places; An incomplete list may be found in [201 §1], 
The results in this paper can be said to make the aforementioned speculative claim 
regarding the effective content of Nonstandard Analysis more concrete. 

By contrast, the following final remark is somewhat vague and speculative, but 
partially explains the connection between the totality of the Gandy-Hyland func¬ 
tional mentioned in [T5] Theorem 9.5.4, p. 460] and Corollaries 14.241 and 14.261 

Remark 4.27 (Partiality in P). The class of partial computable functions is a 
central object of study in computability theory ([22] 1.2.2]). As discussed in the 
latter, there are good reasons to study partial functions. We now discuss how P 
can accommodate partial functionals, despite all functionals being total. Intuitively 
speaking, we show that a total computable function with standard index can out¬ 
put nonstandard numbers for standard input (after running for nonstandard many 
steps). Such a total function may rightly be called ‘not total from the point of view 
of the standard world’ in view of the basic axioms of P. More formally: 

First of all, consider the well-known predicate l <p^ s (n) = to’ which intuitively 
states that: ‘the e-th Turing machine with oracle set A and input n halts after s 
steps with output to’ ([22] Def. 3.8]). Now let eo,xo be standard numbers and A a 
standard set such that (3s°, m°)[ip^ 0 s (xq) = to], i.e. we say that V^(£o)’ is defined 
in the usual computability-theoretic terminology. 

Secondly, the basic axioms of P in Definition 12.11 guarantee that every standard 
functional evaluated at a standard input returns a standard output. By contrast, 
without the presence of II^-TRANS, ^^(a:o) as defined abovc0 may well be non¬ 
standard. In other words, while the value of <pfoi x o) is defined and all inputs are 
standard, the eo-th Turing machine may well take a nonstandard number s of steps 
to halt, with a nonstandard output to, as discussed in Footnote [5] 

Thirdly, in light of the previous, we are led to the following definition: For stan¬ 
dard eo,Xo,A, we say that V^(£o) is standard-defined’ if (3 st s°, m°)[<pt 0 stAo) = 
to], and ‘standard-undefined’ otherwise. Similarly, for standard eo, A, we say that 


®Let h 1 be the counterexample to Ilj-TRANS from the proof of Theorem 14.211 and define eg 
as the program which tests whether xo £ A := {n : h(n) A 0} and outputs xo if so, and repeats 
the previous step for xq + 1 otherwise. 
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l tp£ 0 is standard-total’ if we have (V st .To)(3 st s°, m 0 )[ip^ QS {xo) = m], and ‘standard- 
partial’ otherwise. Hence, define as follows for M £ Q: 


:= 



(3 s°,m°)[<p£ ta (x) 
otherwise 


m] 


Note that this definition makes sense in P+(/i 2 ) and recall that an internal sentence 
such as Aj nt = (/r 2 ) has no impact on the term extraction procedure in Theorem l2.3l 
In particular, the functional from A| n t = (ft 2 ) does not occur in the term t from the 
latter theorem. By definition, ip^ is total but not standard-total in the presence of 
^n°-TRANS by Footnote^ Hence, we can in fact simulate the concept of partiality 
inside P by exploiting the dichotomy between ‘standard’ and ‘nonstandard’. Similar 
definitions are possible for higher-type functionals. 

Finally, we arrive at the motivation for the above definitions: Consider 7 1 £ C as 
in (14.321) : To compute 7 (a) at standard a 1 , one evaluates 7 ( 750 ), 7 ( 751 ), et cetera. 
This computation always terminates by the definition of 7 1 £ C. However, in 
the presence of -inJ-TRANS, this computation only terminates after a nonstan¬ 
dard number of steps, i.e. 7 1 £ C can be ‘standard-partial’ in the above sense. 
However, GH® S and GH” s2 guarantee that there is a standard-total Gandy-Hyland 
functional, and by definition of the latter, 7 evaluates to a standard number for 
certain (standard) input sequences, i.e. 7 is also standard-total, and hence nonstan¬ 
dard continuous. Thus follows NPC® and hence n°-TRANS by Theorem 14.211 


Acknowledgement 4.28. This research was sponsored by the John Templeton 
Foundation, the FWO Flanders, the University of Oslo, and the Alexander von 
Humboldt Foundation. The author is grateful to these institutions for their support. 
The author thanks Dag Normann and Paulo Oliva for their valuable advice. 


References 

[1] Sergio Albeverio, Raphael Hpegh-Krohn, Jens Erik Fenstad, and Tom Lindstrpm, Nonstan¬ 
dard methods in stochastic analysis and mathematical physics, Pure and Applied Mathemat¬ 
ics, vol. 122, Academic Press, 1986. 

[2] Jeremy Avigad and Solomon Feferman, Godel’s functional (“Dialectica”) interpretation, 
Handbook of proof theory, Stud. Logic Found. Math., vol. 137, 1998, pp. 337—405. 

[3] Michael J. Beeson, Foundations of constructive mathematics, Ergebnisse der Mathematik 
und ihrer Grenzgebiete, vol. 6, Springer, 1985. Metamathematical studies. 

[4] Benno van den Berg, Eyvind Briseid, and Pavol Safarik, A functional interpretation for 
nonstandard arithmetic, Ann. Pure Appl. Logic 163 (2012), no. 12, 1962-1994. 

[5] Benno van den Berg and Sam Sanders, Transfer equals Comprehension, Submitted (2014). 
Available on arXiv: http://arxiv.org/abs/1409.6881 

[6] Ulrich Berger and Paulo Oliva, Modified bar recursion, Math. Structures Comput. Sci. 16 
(2006), no. 2, 163-183. 

[7] _, Modified bar recursion and classical dependent choice, LC01, Lect. Notes Log., 

vol. 20, 2005, pp. 89-107. 

[8] Martin Escardo, Seemingly impossible functional programs. See 
http: //math. andrej . com/2007/09/28/seemingly-impossible-f unctional-programs/ 

and http://www.cs.bham.ac.uk/~mhe/.talks/popl2012/ 

[9] Martin Escardo, Paulo Oliva, and Thomas Powell, System T and the product of selection 
functions, Computer science logic 2011, LIPIcs. Leibniz Int. Proc. Inform., vol. 12, Schloss 
Dagstuhl. Leibniz-Zent. Inform., Wadern, 2011, pp. 233—247. 

[10] Martin Escardo and Chuangjie Xu, The Inconsistency of a Brouuierian Continuity Princi¬ 
ple with the CurryHoward Interpretation, 13th International Conference on Typed Lambda 
Calculi and Applications (TLCA 2015), 2015, pp. 153—164. 







28 


THE GANDY-HYLAND FUNCTIONAL AND NONSTANDARD ANALYSIS 


[11] Yu. L. Ershov, Model C of partial continuous functionals , Logic Colloquium 76 (Oxford, 
1976), North-Holland, Amsterdam, 1977, pp. 455-467. Studies in Logic and Foundations in 
Math., Vol. 87. 

[12] Robin Gandy and Martin Hyland, Computable and recursively countable functions of higher 
type , North-Holland, 1977, pp. 407-438. Studies in Logic and Found. Math 87. 

[13] Ulrich Kohlenbach, Higher order reverse mathematics , Reverse mathematics 2001, Lect. 
Notes Log., vol. 21, ASL, 2005, pp. 281-295. 

[14] _, Foundational and mathematical uses of higher types , Reflections on the foundations 

of mathematics (Stanford, CA, 1998), Lect. Notes Log., vol. 15, ASL, 2002, pp. 92-116. 

[15] John Longley and Dag Normann, Higher-order Computability , Theory and Applications of 
Computability, Springer, 2015. 

[16] Edward Nelson, Internal set theory: a new approach to nonstandard analysis, Bull. Amer. 
Math. Soc. 83 (1977), no. 6, 1165-1198. 

[17] Dag Normann, Recursion on the countable functionals, LNM 811, vol. 811, Springer, 1980. 

[18] Abraham Robinson, Non-standard analysis, North-Holland, Amsterdam, 1966. 

[19] Sam Sanders, Taming the Reverse Mathematics zoo, Submitted, Available from arXiv: 
http ://arxiv.org/abs/1412.2022 (2014). 

[20] _, The unreasonable effectiveness of Nonstandard Analysis, Submitted; Available from 

arXiv: http://arxiv.org/abs/1508.07434 (2015). 

[21] Stephen G. Simpson, Subsystems of second order arithmetic, 2nd ed., Perspectives in Logic, 
CUP, 2009. 

[22] Robert I. Soare, Recursively enumerable sets and degrees, Perspectives in Mathematical Logic, 
Springer, 1987. 

[23] Anne Sjerp Troelstra, Metamathematical investigation of intuitionistic arithmetic and anal¬ 
ysis, Springer Berlin, 1973. Lecture Notes in Mathematics, Vol. 344. 

[24] Anne Sjerp Troelstra and Dirk van Dalen, Constructivism in mathematics. Vol. II, Studies 
in Logic and the Foundations of Mathematics, vol. 123, North-Holland, 1988. 




